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ABSTRACT 


Newton’s  method  i  •;  a  well  known  and  often  applied  technique  for  computing 
a  zero  of  a  nonlinear  function.  By  using  the  theory  of  generalized  equations, 
a  Newton  method  is  developed  to  solve  problems  arising  in  both  mathematical 
programming  and  mathematical  economics. 

We  proe^y  two  results  concerning  the  convergence  and  convergence  rate  of 

■"  «/ijl 

Newton’s  m«'thod,for 'general  ized  equations.  Examples  are  given  to  emphasize 
the  application  of  this  method  to  generalized  equations  representing  the  non¬ 
linear  programming  problem  and  the  nonlinear  complementarity  problem. 

Wa  pn'senb  computational  results  of  Newton's  method  applied  to  a  nonlinear 

comp lemrn tan ty  problem  of  Ko j ima , and  an  invariant  capital  stock  problem  of 

OJiA 

A; 
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Significance  and  Explanation 

The  solution  to  many  practical  problems  in  operations  research  and 
mathematical  economics,  such  as  the  nonlinear  programming  problem  and  the 
economic  equilibrium  problem,  can  be  found  bv  solving  a  collection  of 
equations  and  inequalities.  Robinson  |10)  has  show"  that  this  collection 
of  equations  and  inequalities  can  be  written  in  a  form  verv  similar  to 
an  equation,  which  he  calls  a  generalized  equation.  Extensive  work  bv 
manv  researchers  has  created  a  well-developed  theory  and  computational 
algorithms  for  solving  equations.  The  analogy  between  an  equation  and 
a  generalized  equation  can  he  utilized  to  extend  this  theorv  and  algo¬ 
rithms  to  the  more  difficult  problems  involving  equations  and  inequalities. 
In  this  paper,  one  of  the  most  successful  algorithms  for  computing  the 
solution  of  an  equation,  Newton's  method,  is  shown  to  be  applicable  to 
generalized  equations.  To  Illustrate  how  the  method  is  applied  to 
practical  problems,  two  examples  are  solved  using  Newton's  method.  The 
first  is  a  nonlinear  complementar itv  problem  used  bv  Koiima  ( 3 1  to  test 
other  algorithms.  The  second  example  is  the  invariant  capital  stock 
problem  developed  bv  Hansen  and  Koopmans  |2).  Thus,  the  range  of 
problems  to  which  Npvton's  method  can  be  applied  has  been  extended  to 
include  finding  solutions  to  nonlinear  programming  problems  and  equilibria 
in  economic  systems. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  ’fRC,  and  not  with  the  author  of  this  report. 


NEWTON'S  METHOD  FOR  GENERALIZED  EQUATIONS 
Norman  H.  Josephy 

1.  I nt roduct  ton .  A  generalized  equation  Is  .1  -.et-valued  analogut 

of  .1  single-valued  equation.  Many  problems  arising  in  mathenut ical  pro¬ 
gramming  and  muihem.it  ical  economics  can  bo  analyzed  bv  generalizing,  (■> 
the  set-valued  case,  classical  techniques  used  in  the  study  of  single- 
valued  equations.  Prel imitvarv  investigations  of  the  properties  and 
applications  of  generalized  equations  have  been  carried  out  bv  Robinson 
|b ,  7,  8,  9,  10).  This  paper  is  a  contribution  to  this  continuing  research 

Newton's  method  is  .«  classical  technique  of  both  theoretical  and 
practical  Importance  In  the  study  and  computation  of  solutions  to  single¬ 
valued  equations.  The  theory  supporting  Newton's  method  develops  a  set 
of  conditions  under  which  the  iterative  procedure  which  comprises  the 
method  will  converge,  at  a  known  rate,  to  a  solution  of  an  equation. 
Extensive  computational  experience  supports  the  notion  that  under  suitable 
conditions,  this  algorithm  is  an  efficient  computational  procedure.  A 
Newton  method  for  generalized  equations  will  extend  to  problems  in  mathe¬ 
matical  programming  and  mathematical  economics  these  desirable  properties. 

The  definition  and  examples  of  generalized  equations  are  given  in 
section  2.  The  linearization  of  a  generalized  equation  is  defined  in 
section  3,  and  is  illustrated  bv  applvlng  It  to  the  nonlinear  complemen¬ 
tarity  problem  and  finding  a  Kuhn-Tucker  point  of  a  nonlinear  program i ng 
problem.  Tlw  condition  of  strong  regularity  is  defined  in  section  <*.  and 
a  corollary  to  a  result  of  Robinson  (9)  is  stated.  The  two  main  theorems 
of  this  paper,  the  domain  of  attraction  theorem  and  the  Nrwton-Kantorovi rh 

Sponsored  bv  the  United  States  Armv  under  Contract  No.  DAAG29- 7S-C-0024 . 
This  material  is  based  upon  work  supported  bv  the  National  Science  Founda¬ 
tion  under  Grant  No.  DOR  74-20S8/*  and  Grant  No.  MGS  74-20S8i  A02  and  the 
Graduate  School  of  the  University  of  Wi sconsin-Madi son. 


theori  .  ir<  si  i'tii  i  ml  proved  in  -lotion  S.  We  conclude  with  some 
vomput.itlon.il  results  obtained  bv  applying  Newton's  method  to  the  gener¬ 
alized  equation*  representing  i  nonline. ir  v -amp  lenient  ar  i  t  v  problem  of 
Kojina  (1)  and  an  Invariant  capital  stock  problem  of  Hansen  and  Koopmans 
121 . 
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We  can  now  define  a  generalized  equation. 

Definition  2.  Let  (:D<  Rn  ♦  Hn  . 

Let  C  be  a  non-empty,  closed,  convex  subset  of  Rn  . 

A  generalized  equation  is  a  set  relation 
0  .  f  ( x )  4  N(.  ( x )  . 

Definition  3 .  A  solution  x*  of  the  generalized  equation 

0  r  f ( x )  N^(x)  Is  a  vector  x*  satisfying 

0  c  f(x*)  4  N(.(x*). 

Thus,  x*  is  a  solution  if  and  onlv  if  x*  •  C  and  <f(x*),k-x*  >  ^  0 

for  all  k  t  C  . 

The  following  example  shows  the  nonlinear  complementarity  problem 
a$  a  special  case  of  a  generalized  equation  when  the  set  C  is  chosen 
as  a  non-negative  orthant. 

Example  I.  Let  K  be  a  non-empty,  closed,  convex  cone  in  Rn. 
Define  the  dual  cone  of  K,  K*,  to  be 

K* :  -  (y | <y ,k>  =  0  ,  vk  c  M 

Suppose  x  e  K,  y  c  Rn  and  <y,k-x>  *  0  for  all  k  c  K.  This  implies, 
for  k«2x,  that  <y,x>  *  0.  But  choosing  k«Jx  yields  <y,x>  ■  0.  Thus, 
<y,x>  ■  0.  Hence  0  =  <y,k>  -  <y,x>  «  <y,k>  for  all  k  e  K,  that  is, 
y  t  K*.  he  have  thus  shown  that  if  x  c  K  and  <y,k-x>  =  0  for  all  kcK, 


then  x  c  K,  y  e  K*,  and  <x,y>  «=  0.  The  converse  holds  trivially,  that 
is,  if  x  c  K,  y  e  K*.  and  <x,y>  *  0,  then  x  c  K  and  <y,k-x>  =  0,  for 

all  k.  e  K.  Using  Definition  3,  we  have  established  the  following  equiv¬ 

alence  : 

0  c  y  ♦  N^(x)  if  and  only  if  x  c  K,  y  e  K*,  and<x,y>«  0  . 

For  the  special  case  of  K:  *  R^  and  F:Rn  ■*  Rn,  we  have  that 

0  c  F (x*)  ♦  Nk(x*)  if  and  only  if  x*  ^  0,  F(x*)  *  0  ,  and<x* ,F(x*)> 0. 
This  is  the  nonlinear  complementarity  problem. 

In  the  next  example  of  this  section,  we  derive  the  generalized 
equation  which  represents  the  Kuhn-Tuckcr  conditions  for  3  nonlinear 
programming  problem.  The  result  of  Example  l  will  be  used  with  K  de¬ 
fined  as  the  Cartesian  product  of  cones. 

Example  2.  Let  f:Rn  •*  R,  g:Rn  -*  Rm,  and  h:Rn  -»  R^  be  continu¬ 
ously  differentiable  maps,  he  will  consider  the  following  nonlinear 
programming  problem. 

(N.l.P.)  :  min  f(x)  subject  to  g(x)  «  0  ,  h(x)  •  0  . 

We  define  the  Lagrangian  of  (N.L.P.)  as 
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m  p 

L(x.u.w):  *  f(x)  ♦  Z  u  g.(x)  ♦  Z  w.h  (x) 
i«l  1  j-1  J  J 


The  gradient  of  t.  with  respect  to  x  will  be  denoted  VL.  We  say  that 
(x*,u*,w*)  is  a  Kuhn-Tucker  triple  if  and  only  if  VL(x*,u*,w*)  =  0, 
u*  *  0,  g(x*)  «  0,  <u*,g(x*)>  «  0,  h(x*)  =  0.  Let  K:  *  Rn*  R™  *RP, 
the  Cartesian  product  of  cones.  Note  that  the  dual  cone 
K*  «  {0}n  *  R^  *  {0}P  .  Finally,  define  the  function  F  on 
Rn  «  R*  x  RP  to  Rn  »  Rm  *  RP  by 

|  VL(x,u,w) 

F(x,u,w)  -  -  g(x) 


.  -h(x)  j 


'..inf.irir.it  Ion  of  <:e iu*r.i  1  i zed  liquations.  The  approximation  of 
.1  nonlinear  oiju.it  ion  bv  a  linear  equation  is  a  well  known  and  frequently 
successful  technique  used  in  the  study  of  equations.  In  this  section, 
we  define  and  illustrate  the  linear  approximation  of  a  generalized 
equation.  We  begin  with  a  definition. 

Definition  4.  Let  D  be  a  non-empty,  open,  convex  subset  of  Rn  . 

Let  F:D  ♦  Rn  be  a  trap  with  continuous  derivative  F*. 

Fix  x  c  D. 

The  linearization  of  F  at  x,  denoted  by  LF-  is 
defined  as 

LF;(x):  -  F(i)  ♦  F • (x) (x-x)  . 

Thus,  the  linearization  of  F  at  x  is  an  affine  map  passing  through 
the  point  x  having  "slope"  equal  to  that  of  F  at  x.  The  lineariza¬ 
tion  of  a  generalized  equation  at  x  is  obtained  by  replacing  F 

with  LF-  . 
x 

Definition  S.  Let  F:D  ■*  R  have  continuous  derivative  F*. 

The  linearization  of  the  generalized  equation 
0  c  P(x)  +  Nk(x) 

at  x  is  the  generalized  equation 


-f>- 


0  t  LF;(x)  ♦  Nr(x)  . 

We  illustrate  the  linearization  procedure  with  two  examples. 

The  linearization  of  the  generalized  equation  for  the  nonlinear  com¬ 
plementarity  problem  is  given  in  Example  3.  The  result  is  a  linear 
complementarity  problem.  This  is  analogous  to  the  case  of  nonlinear 
equations,  where  linearization  results  in  linear  equations.  The 
linearization  of  the  generalized  equation  for  the  Kuhn-Tucker  triple 
of  a  nonlinear  programming  problem  is  given  in  Example  A.  The  result 
is  a  generalized  equation  equivalent  to  the  Kuhn-Tucker  conditions 
for  a  quadratic  programming  problem.  This  quadratic  program  was  first 
proposed  by  h'ilson  |11]  as  the  subproblem  in  an  iterative  scheme 
to  solve  concave  nonlinear  programming  problems.  The  first  extensive 
analysis  of  the  use  of  these  linearizations  to  solve  certain  problems 
in  both  mathematical  programming  and  mathematical  economics  can  be 
found  in  Robinson  [6)  .  In  anticipation  of  the  remarks  in  section 
5,  we  note  that  the  result  of  a  linearization  of  a  generalized  equa¬ 
tion  will  be  the  subproblcm  in  a  Newton  method  used  to  compute  solu¬ 
tions  to  the  given  generalized  equation. 

Example  3  .  Consider  the  nonlinear  complementarity  problem  in 

„n 

R  : 

F(x)  •  0  ,  x  -  0  ,  <x,F(x)>  «  0  . 

By  Example  1  ,  this  is  equivalent  to  the  generalized  equation 

0  c  F (x)  ♦  Nk(x)  , 


-7- 


where  K:  -  The  linearization  of  this  generalized  equation 

at  x  is 

0  c  »: ( x )  ♦  F'(i)Cx-i)  ♦  Nk(x)  . 

Regrouping  the  constant  vectors  and  relabelling  as  follows: 

a:«  F (x)  -  F* (x)x  ,  M:  «  F’(x) 

the  linearization  can  be  rewritten  as 

0  c  a  ♦  Mx  ♦  N^Cx)  , 

which  is  equivalent  to  the  linear  complementarity  problem 

a^Mx»0,x«0,<x,  a*Mx>  *  0  . 

Thus,  linearization  applied  to  the  nonlinear  complementarity  problem 
results  in  a  1  incar  complementarity  problem.  A  Newton’s  method  for 
solving  a  nonlinear  complementarity  problem  will  then  consist  of  itera¬ 
tively  solving  a  sequence  of  linear  complementarity  problems. 

Example  4.  he  consider  the  linearization  of  the  Kuhn-Tucker 
conditions  for  the  nonlinear-programming  problem,  as  given  in  Example 
2.  Before  doing  so,  we  will  use  the  results  of  Example  ?  to  derive 
the  generalized  equation  whose  solution  is  a  Kuhn-Tucker  triple  for 
the  following  quadratic  programming  problem. 

(Q.P.)  min  l(x-x)"^  H(x-x)  ♦  (x-x)"**c  subject  to 
A(x-x)  ♦  a  «  0  and  B(x-x)  ♦  b  ■  0  , 
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where  x  c  Rn  is  fixed  and  H  is  a  symmetrix  n  *  n  matrix.  Let 
-  T  T 

D(x,u,w):  =  H(x-x)«  c  ♦  A  u  ♦  B  w  be  the  gradient  of  the  Lagrangian 
for  (Q.P.).  Using  the  results  of  Example  2,  a  Kuhn-Tucker  triple  must 
satisfy  the  generalized  equation 


0  c  F(x,u,w)  ♦  Nk(x,u,w)  , 

where  K:  ■  Rn  x  R™  *  R^  and 
♦ 


(4) 


'D(x.u.w)  - 

! 

r  t  t  l 

H  A  B 

I 

-A(x-x) -a 

B 

-1* 

♦ 

-A  0  0 

♦  u 

_  -B(x-x) -b 

1  1 

,.-bJ 

1 

-BOO 

w  — 

L  w  j 

Now  consider  the  nonlinear  programming  problem  of  Example  2. 
(N.L.P.):  min  f(x)  subject  to  g(x)  ■  0  and  h(x)  *  0  . 

The  gradient  of  the  Lagrangian  for  (N.L.P.)  is 

■  P 

VL(x,u,w):  «  Vf (x)  ♦  I  u.Vg  (x)  ♦  I  w  Vh  (x) 

i»l  11  j«l  3  J 


As  in  Example  2,  a  Kuhn-Tucker  triple  for  (N.L.P.)  is  a  solution  to 
the  generalized  equation  (K.T.),  defined  by 
(K.T.):  0  c  F (i)  ♦  Nk(z) 

where  z:  •  (x,u,w),  K:  «  Rn  *  R®  *  Rp  ,  and 

r  vl(z)1 


F(z); 


-g(x) 
-h(x)  J 
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Let  G(x) :  -  (Vg1(x),...,VgjB(x)J  and  H(x):  -  (Vhj  (x) . Vh^x)) 


Then  the  derivative  of  F  at  z:  ■  (x,u,w),  F'(z),  is  the  matrix 


V2L(i)  G(x)  H(x) 
F • (r)  •  -CT(x)  0  0 

*HT(x)  0  0 


,  and  the  linearization  of 


F  at  z  is  LF £ ( r ) :  ■  F(z)  ♦  F'(z)(z-z).  After  some  algebra,  the  lineari¬ 
zation  can  be  written  as 


Vf(i) 

V2IU) 

G(x) 

H(x) 

e-» 

x-x 

LF-(z).  -g(i) 

♦ 

-GT(x) 

0 

0 

• 

u 

a 

-h(i) 

-HT(i) 

0 

0 

w 

L  _ 

L 

J 

and  the  linearization 

of  (K.T.)  la 

0  c  LF- 

T 

<z)  ♦ 

S'  (z).  Comparing  this  to 

the  Renrr a  1 l red  equation  for  (O.P.),  we  see  that  the  linearization 
of  the  generalized  equation  (K.T.)  ha«  as  its  solution  the  Kuhn-TucVcr 
triple  for  the  quadratic  program 


■in  l(x-x)  V*L(z)(x-x)  ♦  (x-x)^Vf(x)  subject  to 
Lg-(x)  ■  0  and  Lh-(x)  •  0  • 

Thus,  an  iterative  procedure  which  attempts  to  find  the  solution  to 
a  nonlinear  programming  problem  by  successively  solving  the  linearized 
generalized  equation  will  replace  a  general  nonlinear  programming  problem 
with  a  sequence  of  quadratic  programing  problems. 
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.  Strong  Regularity.  An  important  element  in  the  analysis  of 
N«-vton's  method  'or  solving  the  equation  0  -  fix),  where  f  :Kn  *  Kn 
has  derivative  t ’  ,  is  the  behavior  oi  (f'(x))  1  tor  x  in  a  neigh¬ 
borhood  ot  a  Nr!  io  ■  .  The  analogous  element  for  generalized 

equations  is  the  behavior  of  the  set-valued  map  (Lf  +  X  )  '  for  x 
in  a  neighborhood  of  the  solution  x  .  We  begin  with  a  definition. 

Dcfir.it  ion  6.  Let  T  be  a  set-valued  map. 

Then 

T‘\y):  -  ( *  1  y  eT(x)> 

It  follows  that  T  * (0)  ■  {x  0  c  T(x)}  is  the  solution  set  of  the  gen¬ 
eralized  equation  0  c  T(x).  Ke  arc  interested  in  T* 1  when  T  « 

Lf-  ♦  N„.  The  notion  of  strong  regularity,  introduced  in  Robinson 
t  ]  describes  the  behavior  of  (Lf-  ♦  >L)  '  appropriate  to  the  con¬ 
vergence  of  Newton’s  method. 

Definition  7.  (Robinson  [9  ]).  Let  0  c  F(x)  ♦  N^. (x)  have  a  solu¬ 

tion  z.  Let  T:  •  LF^  ♦  N^.  . 

Then  z  is  a  strongly  regular  solution  of  0c  F(x)  ♦  N^fx) 
if  and  only  if  there  exists  a  neighborhood  U  of  the 
origin,  and  a  neighborhood  K  of  z,  such  that  the 
restriction  of  W  T’1  to  U  is  a  single-valued  and 


Lipschitz  continuous  nap. 


The  map  W  T  *  is  defined  by  (W  T  *)(y)  :*  W  T  *(y)  .  As 
noted  bv  Robinson  (91,  if  K  •  Kn  ,  then  the  general ired  equation 
reduces  to  the  equation  0  •  F(x),  and  strong  regularity  is  the 
condition  that  F'(a)  has  a  continuous,  linear  inverse.  Condi¬ 
tions  under  vb 1  »be  nonlinear  complementaritv  problem  of  Example 
1  and  the  nonlinear  programming  problem  of  Example  2  are  strongly 
regular  can  be  found  in  Robinson  (9). 

We  conclude  this  section  with  a  corollary  to  Theorem  2.4  of 
Robinson  (9). 

Corollary  1.  Let  C  be  a  closed,  convex,  nonempty  subset 
of  Rn,  and  let  D  be  an  open,  convex,  nonempty  subset  of  R°.  Let 
f:D  -•  Rn  have  Frechet  derivative  f.  Suppose  x^  c  D  and  the  gener¬ 
alized  equation  0  c  Lf  (x)  *  N  (x)  has  a  strongly  regular  solution 

*0  L 

Xj  with  associated  Lipschitz  constant  d.  Then  there  exist  positive 
constants  p,  r,  and  R  such  that  the  following  holds: 

For  any  x  satisfying  j{x - xQ [|  ■  o, 

(Lf  ♦Nr)~1  B(x  ,r)  restricted  to  B(0,R)  is  single- 

valued  and  Lipschitz  continuous  with  modulus 
d(l-d  |P(x)  -  f(x0)B  f1  , 

where  6(x,s):  •  {x  |  l|x-x||  ■  s  }  . 
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V  Newton* a  Method  f  or  General  i  Equation*.  Kawi  n'a  Ml 


tor  solvinR  systems  of  equations  is  an  iterative  procedure  in  which  e.»<  h 


Iteration  involves  the  solution  of  a  linear  svstem  of  equations.  There 


is  an  abundant  literature  on  this  technique.  (See  Ortega  and  Rheinboldt 


1  s |  and  Rail  (I)  as  representative  samples  of  the  literature).  In  this 


section,  we  will  briefly  recall  Newton's  method.  We  then  prove  two 


fundamental  results  on  Newton's  method  for  generalized  equations,  the 


domain  of  attraction  theorem  and  the  Newt on-Kant orov i ch  theorem 


Let  0  be  an  open,  non-empty  convex  subset  of  R  ,  and  let 
f:D  -*  Rn  be  a  continuously  differentiable  r.ap.  Newton's  method  for 
solving  the  equation  0  ■  f(x)  consists  of  replacing  f  by  Lf-  and 
solving  0  •  Lf- (x) .  The  point  x  is  some  approximation  to  a  zero  of 
f.  A  solution  x  to  the  linear  system  replaces  x,  and  the  process 
is  repeated  (see  Figure  1). 


Newton's  method  for  a  generalized  equation  0  c  F(x)  ♦  N^.(x) 
consists  of  replacing  F  by  LF-  and  solving  the  linearized  equation 
0  c  LF-(x)  ♦  N^(x).  The  iteration  procedure  for  generalized  equa¬ 
tion  is  formally  identical  to  that  in  the  case  of  a  single-valued 

equation  0  •  f(x). 


Figure  1.  Newton  Iterates 


The  domain  of  attraction  theorem  anJ  the  Newton- kantorov ich 


theorem  are  two  fundamental  results  which  describe  the  behavior  of 
the  Newton  iteration  process.  The  domain  of  attraction  theorem  as¬ 
sumes  that  a  solution  to  an  equation  exists.  Under  conditions  re¬ 
lated  to  the  behavior  of  the  linearized  equation  in  a  neighborhood 
of  the  solution,  a  region  is  specified  in  which  a  vector  used  as  an 
initial  value  for  the  iteration  process  can  be  chosen.  Any  such  initial 
choice  will  lead  to  a  well  defined  sequence  which  converges  quad- 
ratically  to  the  assumed  solution. 

The  Ncwton-kantorovich  theorem  is  an  existence  result.  Under 
conditions  related  to  the  behavior  of  the  linearized  equation  in  the 
neighborhood  of  an  initial  value,  it  states  that  the  Newton  iterates 
arc  well  defined  and  converge  to  a  solution  of  the  original  equation. 
The  proof  techniques  for  both  theorems  arc  adaptations  to  the  gener¬ 
alized-equation  case  of  classical  techniques  taken  from  Ortega  and 
Rheinboldt  f 4 ] . 

Theorem  1  is  the  domain  of  attraction  result.  Kc  assume  f' 
is  l.ipschitz  continuous  on  a  region  D.  Ke  also  assume  that  the  equa¬ 
tion  0  c  f(x)  ♦  N-C(x)  has  a  strongly  regular  solution  x*.  This  im¬ 
plies  the  existence  of  a  neighborhood  of  0,  say  U,  ar.d  two  neighbor¬ 
hoods  of  x*,  say  V  and  K,  such  that  for  x  c  K,  T^ :  «  (l.f  ♦  N'^l  *  ft  V 
restricted  to  U  is  single-valued  and  Lipschitz  continuous.  The  hy¬ 
potheses  of  the  theorem  will  guarantee  that  each  iterate  remains  in 
h  D,  and  the  linearization  of  f  at  each  iterate  and  f  itself  are 
close  in  value  at  x*.  This  and  the  l.ip$chitz  continuity  of  T^  will 
establish  the  theorem. 
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Theorem  r  is  the  Vewton-Ksntorov ich  theorem.  The  same  assump¬ 
tions  are  ma«Je  on  f  and  f'.  The  linearization  of  0  c  f(x)  ♦  ^.(x) 
at  some  initial  point  x^  is  assumed  to  have  a  strongly  regular  solu¬ 
tion  Xj.  The  hypotheses  of  the  theorem  will  guarantee  properties 
of  T^  similar  to  those  in  Theorem  1.  The  method  of  scalar  majorants, 
described  in  detail  in  Ortega  and  Rheinboldt  (  4  ),  is  then  invoked 
to  establish  the  theorem.  The  major  results  of  the  method  of 
majorants  are  summarized  in  Lemma  A  appearing  in  the  appendix. 

Ke  will  denote  the  closed  ball  about  x  with  radius  r  by 

6(x.r). 

Theorem  1 .  Let  C  be  a  nonempty,  closed,  convex  subset  of  Rn, 
and  let  P  be  a  nonempty,  open,  convex  subset  of  Rn.  Let  f:D  Rn 
have  a  Lipschit:  continuous  F rochet  derivative  f'  with  Lipschit:  con¬ 
stant  b.  Suppose  the  generalized  elation  0  c  f(x)  ♦  Nc(x)  has  a 
strongly  regular  solution  x*  with  associated  Lipschit:  constant  d. 

Let  p,  r,  and  R,  all  positive,  be  the  constants  associated  with 
strong  regularity,  as  given  in  Corollary  1.  Let  xQ  c  P,  and  define 
the  following  notation. 

»:  •  II* *  -  *0!l 

S  :  ■  Lf  ♦  N. 

x  x  C 

a:  ■  d(l-dbm)  * 

h:  *  Jabm 

Suppose  that  the  following  relations  hold: 

(1)  dbm  <  | 

(2)  Jbm2  <  R 

(3)  m  <  p 

(4)  B(x*,m)  c  D  n  B(x*,P) 
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Then  h  <  1,  the  sequence  given  by 

Vf'  *  (Sx  )1{0)  ft 
n 

is  well  defined  and  satisfies  the  following  relations. 

(5)  II  Vl  '  X*H  *  iabH  xn'x*H  2 

(6)  ||  xn^  -  x-||  *  2-  (ab)  h(2" 

Proof.  We  first  define  the  following  notation. 

Tx:  •  B(x*,r)  n  S*1  and  T^:  ■  Tx 

g(x):  -  d(l-d  H  f'  (x)  -  f  *  (x-)  (I  )‘! 

J(x):  -  Lfx(x*)  -  Lfx.(x«) 

We  next  establish  the  following  relations. 

(7)  ||  Tx(u) -Tx(v)  ||  *  a  i|u-v  ||  for  all  x  c  6(x*,m)  and  u,v  c  6(0, R), 

(8)  x*  c  S^fJtx))  for  all  x  c  D  , 

(9)  x*  -  Tx(J(x))  for  x  t  6(x*,m)  and  J(x)  c  6(0, R)  , 

(10)  ||  J(x)||  S  |||  x-x*||2  . 

Corollary  1  establishes  that  Tx  is  single-valued  and  Lipschitz  con¬ 
tinuous  with  modulus  g(x)  whenever  x  c  6(x*,o).  Also, 

||  f'(x)  - f •  ( x • )  I]  *  bjj  x- x*  ||  «  bm  for  x  c  B(x*,m)  c  6(x*,p)  n  D, 
thus  g(x)  »  d(l-dbm)~*  ■:  a.  Since  g(x)  is  the  Lipschitz  constant 
for  Tx,  (7)  is  proven.  Now  let  x  c  D.  Then  we  have 

0  c  f(x«)  ♦  Nc(x*)  -  ♦  Nc(x*) 

-  LfxC**)  -  J(x)  ♦  Nc(x*) 

■  -J(x)  ♦  Sx(x*)  ♦  Nc(x*) 
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Thus,  J(x)  t  S  (x*),  which  establishes  (S) .  Equation  (9)  follows 
from  (8)  and  T  being  single-valued  on  B(x*,m).  For  c  D,  Lemma 
A. 3  yields  (10).  Finally,  we  have 

(11)  h  <  1 

since  h  ■  Jabm  »  ] *dbm* ( 1 -dbm)  '  =  ]  -py  ,  where  c:  ■  dbm,  and  h  <  1 

c  2 

if  and  only  if  i  y-^  <  1,  which  occurs  if  and  only  if  ~  >  e:  =  dbm, 

and  this  is  hypothesis  (1).  The  next  part  of  the  proof  consists  of 

> 

using  induction  to  prove  that  the  following  hold  for  all  k  =  1. 

(12)  x^:  *  T^  j (0)  is  well  defined, 

(13)  ||  xfc-x*  ||  «  lab ||  xfc_  j -x*  ||  2  *  h«n 

(14)  J(xk)  e  6(0, R) 

We  first  show  that  (12),  (13)  and  (14)  hold  for  k*l.  By  Corollary 

I  »  Tq(0)  i*  single-valued.  Hence  (12)  holds.  By  (10)  and  (2), 

II  J(*0)A  *  | H  *0-**ll2 “7”^  R’  and  thus'  b>’  x*  * 

he  can  now  estimate  the  distance  from  x^  to  x*.  Ke  have 

II  *,-**11  B  l|T0(0)-T0(J(x0))||  ^  a||  J(xQ)||  by  (7) 

«  lba||  xq- x *  || 2  -  Jabm2  by  (4)  and  (10) 

»  hm  <  m  by  (11) 

Hence,  by  (3)  and  (4),  x^  e  B(x*,m)  c  D.  We  can  also  estimate  the 
norm  of  J(Xj).  Using  (10),  we  have 
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II  J(*j) 


*  ^11  vx*‘ 

1 3  »  ib(hm) 

<  Jbm*- 

by  (11) 

<  R 

by  (2). 

•y  y 
ibm~*h‘ 


Thus,  (12),  (13),  and  (14)  hold  for  k»l.  Proceeding  with  the  induc¬ 
tion,  we  assume  that  (12),  (13)  and  (14)  hold  for  all  k*n  and  show 
that  they  also  hold  for  k«n»l.  By  (13),  (3)  and  (11),  it  follows 
that  (7)  holds  for  x  «  xfl.  By  (14)  and  (9),  x*  -  Tn(J (xr) ) .  Thus, 

x  •  T  (0)  is  well  defined  and 
n*  i  n 


11  Vl***11  "  IV°>  •  Tn(J(xn,)B  “  aH  J<xn>  11  by  (7)’ 

•  iba||  xn-x*  H2  by  (10).  (13).  and  B(x*,m)  c  D, 

•  Iba(hm)2  by  (13) 

■  h^*m  <  hra  <  m. 

Also, 

II  J(*n4l>l!  ”  ibH  Xn»rx*H2  by  (10)  and  *„♦!  c  B(x**")  c  D  » 

■  lb(hm)2  *  }bm‘  <  R  . 

Thus,  (12),  (13),  and  (14)  are  established  for  k*n»l.  This  completes 
the  induction.  Relation  (5)  follows  directly  from  (13),  and  (6)  fol¬ 
lows  from  (5)  by  induction.  This  completes  the  proof. 


Theorem  2.  Let  C,  D,  f,  b,  and  be  as  in  Theorem  1.  Let 

xQ  c  D  and  assume  that  the  generalized  equation  0  c  S  (x)  is  strongly 

x0 

regular  at  Xj.  Let  p,  r,  and  R  be  the  positive  constants  associated 
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with  strong  regularity,  and  d  the  associated  Lipschit:  constant,  as 

Riven  in  Corollary  1.  Let  m:  ■  ||x  -x  ||  and  t*:  *  (db)  1  (1- ( 1  - 2a)  ^), 

where  a:  *  dbm.  Suppose  that  the  following  relations  hold:  a  =  i„ 

jbm‘  =  R,  and  B(xn,t*)  D  B(x  ,p).  Then  the  sequence  {x  }  defined 
u  u  r* 

by 


xn«r  "  s*1(0)  n  6<vr) 

Xn 


is  well  defined,  converges  to  some  x*  c  B(x^,t)  which  satisfies 
0  c  f(x*)  4  Nc(x*),  and||x*-xn||  •  ( 2nbd)'!  (2a)(2  )  for  nBl-2** 


Proof.  Kc  first  define  the  following  notation. 
g(x) :  •  d ( 1  -db ||  x- xQ ||  )'*  , 

G(t) :  -  (ldbt2-m)  (dbt-1)'1  , 

Q(».t):  -  Cldbs2)  (1-dbt)'1  , 

tQ:  -  0  ,  tk+1:  »  G(tk)  for  k  «  0  , 

Tn:  -  §(x  ,r)  n  s;1  , 

n 

Lf  :  -  Lf  , 
n  x 


f(x  )  -  Lf  ,(x  )  . 
v  n'  n-lv  n' 


Before  beginning  the  induction  part  of  the  proof,  we  prove  the  follow 
ing  relation  holds: 

<15>  Vl  •  WVl>  "l’e"  xn*  xn.l  1  l(Vt-)  • 

x  :  *  T  (0),  J  .  c  §(0,R)  and  T  ,  restricted  to 
n  n  n^  i  n* i 
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6(0, R)  is  single-valued. 

By  definition  of  Tn,  x^  c  B(Xj.r)  and  0  c  Lfn(*r,4l)  ♦  NC(x„4l)* 

Thus 

•If  ,  (x  .)  -  J  ,  .  N_(x  ,) 
n*l'  n^l7  n»l  Cv  n*l' 

Rearranging  results  in  J  .  c  (Lf  ,  ♦  N_)(x  ,)  ,  that  is, 

n*i  nM  l  n*i 

Vl  c  (Lfn*l  "NC)1(Jn*l)  *  Since  Jn*l  c  6(0*R)  and  Vl  c  6(Vr)* 

we  have  x^j  •  ^n.i^n4j)»  which  is  (15).  We  now  proceed  by  induc¬ 
tion  to  prove  the  following  for  all  n  ■  1. 

(16)  restricted  to  6(0, R)  is  single-valued  and  Lipschitz  con¬ 

tinuous  with  Lipschitz  constant  g(x  ). 

(,7)  H  Vl^n11  '  Q(H  xn"xn-l  ^  VXoll  >  *  where  Vi:  “  V0)  ’ 
<l8>  Vl  ‘  6<Vt#>  * 

09)  II  VJ"  R* 

We  first  show  that  (16)  to  (19)  hold  for  n-1.  By  Leona  A.l  (4), 
tj  ■  t*.  By  definition,  t^  ■  C(tQ)  •  ■  •  ||xj-x0||  .  Hence, 

*1  c  ®(xo*V  c  c  D  n  6<Vp)  * 

By  Corollary  1,  Tj  restricted  to  §(0,R)  is  a  single-valued  and 
Lipschitz  continuous  map  with  modulus  d(l-d||  f*  (x^)  -  £»  C*q)  t!  )"*• 
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By  hypothesis.  || f  •  (x,)-f '  (xQ)  ||»  b]|  x J-x()||  ,  so  that  d(l-d||  f'(x,)  - 
f,(x0)!l  )  1  “  K(Xj).  Hence,  (16)  holds  for  n=l .  Now  define 

x2  «  T,  (0) .  By  Lemma  A. 3.  :  «  fJfCXj)  -  Lf0(x,)||  =  Jb||  Xj-XqII2  = 

jbm  =  R. 

Thus,  J,  c  B(0,R)  and  by  (16), 

II  T,(Jj)  -  1,(011  ^  g(x,).||  J,  ||  i  ]db||  x,-x0!|2(l-db||  x,-x0||  )_1 

■  qc H  vx0H  -II  xrx0ll  )• 

But  x^  ■  T, (0)  and  by  (15),  x,  ■  T,(J,),  hence  we  have 

II  x2*xill  "II  V0)  "  *  This  establishes  (17)  when  n«l.  By 

Lemma  A. 2(6),  x2  c  i^.t*).  Thus,  (18)  holds  for  n»l.  Also, 
x^  c  6(xQ,t*)  c  D,  and  thus 

II  J2H  :  "  ||f(*2^LfiCx2)  II  “  lb ||  x2~x1  II 2  »>y  bemma  A. 3 

■  ib(t2*t,)2  by  Lemma  A. 2(9) 

•  Ibm2  2  1  by  Lemma  A. 1(5) 

“  R  by  hypothesis. 

Thus,  (19)  holds  for  n«l,  and  we  have  completed  the  induction  when 
n»l.  Suppose  that  (16)  to  (19)  hold  for  all  n*k.  We  proceed  to  show 
that  they  also  hold  for  n-k*l.  By  (18),  xkt,  t  &(xQ,t*)  c  B(xQ,p)n  D. 
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By  Corollary  1,  restricted  to  R(0,R)  is  single-valued  and 

Lipschit;  continuous  with  modulus  d(l-d||  f •  (x^ ^ j )  *  f'(x0)!l  )’*  • 

By  hypothesis,  ||f’(xk+1)  -  f’(*0)|!  ■  b||  *k4l-*0ll  •  Thus, 

g(x^j)=  d ( 1  - d 1 1  ^'(xk,j  '  f(xQ)  II)'1.  Hence  (16)  holds  for  n*k*l. 

Let  x^:  *  Tk<1(0).  By  (15)  to  (19),  x^j  «  Tk4j^Jk*^-  Thus* 

M  Xk*2'Xk«l*  “  ''Tk*l^°^  “  Tk*l(Jk*l^  “  g(xk*l^  Jk*l^ 

•  *(Vi),ibH  vrxk®2 

-  Q ( II  *k*i'xkll  .11  V,-X0II  )  • 

This  establishes  (17)  for  n  «  k*l.  It  follows  from  l.cmma  A. 2(6)  that 
Xj^2  c  B(Xp,t*)  D,  thus  (18)  holds  for  n«k*l.  Now, 

IUk.2»-  Hf<xk.2>  •  “li'V;" 

■  Jb||  xk42  -  xk^j  ||  2  by  Lemma  A.  3, 

"  lb^lk+2  *  tk»l)2  by  Lcnuna  A,2(9)  » 

■  Jbm^  by  Lemma  A. I  (15)  , 

•  R 

Thus,  (19)  holds  for  n«k«l,  which  completes  the  induction.  By  Lemma 
A. 2,  the  sequence  (x^)  converges  to  x*  t  6(x^,t*)  and 
I)  x*-xn||  *  (2nbd)  1  (2a)  ^  \  It  remains  to  show  that  x*  is  a  solu¬ 
tion  to  the  generalized  equation  0  c  f(x)  ♦  Nc(x).  Let  graph  Nc 
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denote  the  graph  of  N^.,  that  is,  graph  *  {(u,v)|  vcN^Iu))  . 
The  assumptions  on  C  imply  that  graph  is  a  closed  subset  of 
Rn  *  Rn.  By  construction, 

(Vl*  *  Lfn(Vl})  c  *raph  V 

It  follows  from  the  continuity  properties  of  f  and  f ’  on  D  that 
(x  -  Lfn(xn^j))  converges  to  (x*.  -  f(x*)).  Since  graph  Nc  is 
closed,  (x*,-f(x*))  belongs  to  graph  Nc>  which  implies 
0  e  f(x*)  ♦  N_(x*).  This  completes  the  proof  of  the  theorem. 


6.  Computational  Results.  W'e  present  the  results  of  applying 
Newton's  method  to  two  nonlinear  complementarity  problems. 

Kolima  | 3 )  Rives  the  following  nonlinear  complementarity  problem: 
f(x)  ^  0  ,  x  >  ,  <  x,f(x)  >  ■  0  ,  where 


2  1 
♦  2x‘  ♦  x,  ♦  3x,  -  6  1 


t  < x)  :■ 


;  3*i  *  "*1*2  *  -*2  *  *i  • 

2  2 

2x,  ♦  x,  ♦  x,  ♦  3x,  +  ’x.  -  2 
112  3  4 

2  2 

3x  +  x,x„  ♦  ?x„  ♦  2x,  +  3x, 


1  ? 


L  xi  +  3x? 


♦  2x,  ♦  3x,  -  3 


x  (*!,*,. x3,x4)  c  R  . 

The  unique  solution  of  the  problem  is  given  as 

Xj  »  .r/2  "  1.2247/49  ,  x,  •  0  ,  x^  -  0  ,  x^  •  0.5. 

The  generalized  equation  representing  this  nonlinear  complementar itv  problem 
is 


0  c  / ( x)  ♦  N  . (x)  . 

The  linearization  of  this  generalized  equation  at  the  point  x  is 


0  r  f(x)  ♦  f'(5)(x-S) 

+  **  • 
K 

where 

• 

▼ 

6X1  4 

2x,  2x j  +  4x, 

l 

3 

r<;>  - 

A*1  4 

1  2x2 

3 

2 

1 

6X1  + 

X,  X  ♦  4x, 

1  L 

*  2 

3 

1 

■’x 

‘X1 

6x? 

3 

3  _ 

I f  we  let  o 

f(5) 

-  r ' (x ) • x  and 

M  f'(x) 

,  then  the  linearization 

corresponds  to  the  linear  complementarity  nroblem 

x^O,  Mx  +  q^Q,  <  x,  Nx-Hj  >  •  0  . 
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Lemke 1  s  complementary  pivot  algorithm  (Cottle  and  Dantzig  ill)  is  applied 
to  the  above  linear  conn  leraent  ar  it  v  probleir.  with  the  following  results,  as 
tabulated  in  Table  !.  Three  start inu  points,  listed  in  column  1,  all  lead 
to  a  convergent  sequence  of  linear  problems.  Column  2  lists  the  number  o' 
linear  complementarity  problems  solved,  with  the  fJnal  values  of  x  and  1 
listed  in  columns  3  and  4  ,  respect ive lv .  Each  linear  complementarity  prob¬ 
lem  produced  a  solution  after  two  pivoting  operations  of  the  Lemke  algorithm. 
Thus,  tor  example,  when  the  algorithm  starts  at  x  ■  (i.S.S,1)),  there  are 
six  linear  comolementaritv  problems  solved  before  the  solution  to  the 
original  nonlinear  complementarity  problem  is  found.  Each  linear  complemen¬ 
tarity  problem  Is  of  size  4-4,  and  each  Is  solved  ir.  two  pivots  of  Leroke's 
algorithm.  Thus,  a  total  of  six  derivative  evaluations  and  twelve  pivot 
operations  are  required  to  solve  this  problem  using  Newton's  method  with 
Initial  condition  x  «  (5, 5, 5, 5). 

Table  l  Kojina  tmanrle 


tnltlal  «  Iteration*  float  «  Final  < 


(». 

.1- 

.1. 

.1.) 

4 

(1.2247**9,  0.  0,  .*999999) 

<.6-10*\  3.22*743,  3.000000,  -.3-10-7) 

(3. 

.3. 

.3. 

.3.) 

3 

•  •M 

<-.6-10'\  l.::*7*3.  *.9999999,  -.6. n‘*) 

<3. 

.3. 

.3.) 

• 

**•* 

<-.W0"*,  3. 22*773.  4.99S999S, 

The  second  nonlinear  complementarit v  problem  is  taken  from  Hansen  and 

•>t  -r 

Koopmans  ( 2 ] .  let  v  be  a  real-valued  'unction  on  k”  ,  and  consider  the 


follm/ing  maximization  problem. 


max  v(x)  subject  to 

Ax  z  ,  Bx  x  ,  Cx  •  w  ,  x  0  , 

where  w  Is  a  constant  vector  and  r  is  fixed  for  the  moment.  The  Kuhn- 
Tucker  conditions  for  this  problem  are 

d(*.<lj,<l,.r):»  -7v(x)+ATa  j-B1q1+CTr  0,  x  _  0,  (  d(  x  ,q  j  ,q,  ,  r )  ,  x  >  -  0, 
w-Cx^O.r^O,  ( v  -  Cx , r  >  •  0  , 

*-Ax>Q,qj^0,  <r-Ax,qj>  -0, 

Bx  -  z  ^  0  ,  q ^  0,  <  Bx  -  z,q  ,  )  ■  0  , 

where  7v  denotes  the  "radient  of  v  .  rix  a,  0  ■  a  <  1  .  The  invariant 
stock  problem  o*  Hansen  and  Koopmans  [ ? )  consists  of  finding  a  vector  z* 
such  that  for  some  xA,  q*,q*  and  r*  , 

(i)  (x*  ,c*  .c'i ,  r*)  satisfy  the  Kuhn-Tucker  conditions  whpn  z»z*  , 
and 

(ii)  q *  -  3qJ  . 

Replacing  q,  by  iPj  in  the  Kuhn-Tucker  conditions  results  in  the 
fol Irving  condi 'ions  which  x*,q*  ,  and  r*  must  satisfy.  The  subscript 
1  on  qj  has  been  dropped. 

d*(x,q,r)  -”v(x)  +  (AT-'iBT)q  ♦  CTr  >0,  x  '  0,  <  d*(  x  ,q  ,r)  ,x  >  •  0  , 

w-Cx^O.r'O,  (w  -  Cx,r  >  -  0  , 

(ill)  z-Ax^0,  q  >  0  ,  (  z  -  Ax,q  >  ■  0  , 

(iv)  Bx  -  z  >  0  ,  q  ^  0  ,  (Bx  -  z,q  >  •  0  . 

However,  conditions  (lit)  and  (iv)  can  he  replaced  bv  (B-A)x  >  0  ,  q  >  0, 
(  (B-A)x.q  >  •  0  ,  since  anv  x  and  q  satisfying  this  condition  will 
also  satisfy  (ill)  and  Civ)  with  z  ”  Ax.  The  converse  is  immediate. 

Thus,  we  have  the  following  nonlinear  complementarity  problem. 
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dMx.q.r)  0  ,  x  _  0  ,  <  d*( x ,q , r) , x  >  -  0  , 

w  -  Cx  ^  0  ,  r  _  0  ,  <w  -  Cx,r  )  -  0  , 

iB-.\)x  C  ,  q  m  0  ,  <  (B-A)x,q  >  -  0  . 

Hu-  ,'en«T.i  1  i ;;cd  equation  represent  inp.  this  problem  is 


'  .Vv(xf 

0 

cT 

> 

-4 

1 

as 

x 

0  c 

w  •*. 

-c 

0 

o  '• 

r 

C 

M  J 

B-A 

0 

0 

J 

A 

+  S  (x,r,q) 

RS 

+ 


where  s  Is  the  sum  of  the  dimensions  of  x,r  and  q  .  The  linearization 
at  (x,r,q)  of  this  generalized  equation  is 


•  •  2  -  ~ 

-■'v(x)  +  7  v(x)  •  X 

-72v(x) 

cT 

T  T~ 

A-oB ' 

rx" 

w  + 

-C 

0 

0 

• 

r 

1 

o 

1 

B-A 

0 

0 

i - 

a 

i 

which  corresponds  to  the  linear  complementarity  problem 
Mx  +  t  >  0  ,  x  >  0  ,  <  x,Mx+t  >  •  0  ,  where 


-?V(x)  ♦  V-vfx)  •  x 


-t2v(x) 


at  -„bt 


The  results  of  applvlntt  l.emke's  alp.orithm  to  this  linear  complementarity 
problem  is  summarized  in  Table  2.  Tor  the  value  of  a  listed  in  column  1, 
each  component  of  x  is  initialized  to  the  value  aiven  in  column  2.  The 
number  of  iterations  performed  to  reach  the  solution  published  in  Hansen 
and  Koopmans  [2,  Table  2)  is  listed  in  column  3,  and  the  averaae  number 


of  pivots  needed  in  I.emke's  algorithm  to  compute  each  iterate  is  given 
in  column  4.  It  should  be  noted  that  potential  difficulties  exist  in 
applying  Newton's  method  to  this  problem,  since  the  derivative  7v  does 
not  exist  for  certain  values  of  x  .  However,  this  difficulty  did  not 
arise  for  the  initial  conditions  chosen  as  test  cases. 


Table  2 

Hansen-Koopmans 

Example 

a 

Initial  x 

I  terat ions 

Av.  Pivots  per  It. 

.7 

.1 

8 

10 

.7 

,  2 

14 

10 

.7 

.5 

14 

10 

.8 

.3 

11 

10 

.9 

.3 

8 

14 

APPENDIX  A 


RESULTS  FROM  ORTEGA  AND  RHEIN BO LDT  |41 

The  following  two  results  can  be  found  in  Chapter  12  of  Ortega 
and  Rheinboldt  (  4  ).  The  third  result  is  standard. 

lemma  A. 1 .  Let  d  >  0,  b  >  0  and  m  >  0.  Let  a:  *  bdm  and  sup¬ 
pose  a  >  ].  Let  f:  -  (bd)'1 (1- (l-2a) *)  and  f:  -  (bd) ' 1  (1*  (l-2a) 1 ) 
Define  t^:  ■  0  and  t^ji  *  G(tk),  ^  whcre  G(t):  «  (}dbt^-m) (dbt- 

1)**.  Let  Q(s,t):  ■  (Idbs'1')  (1-dbt)*  * .  Then  the  following  hold. 

(1)  tk^  -  tk  ♦  Q(tk-tk.rtk)  for  all  kil. 

(2)  G  is  monotone  non-decreasing  on  (0,t*)  . 

(3)  t*  is  the  smallest  fixed  point  of  G  on  (0,t**J. 

(4)  lim  tk  ■  t*  ,  and  the  sequence  { t k >  is  monotone  increasing. 

(5)  tkM-tk  ■  m*2_k  for  all  k  -  0  . 

(6)  tk4l  i  2[l-(l)k°)  m  for  all  k  -  0  . 

(7)  If-tJ  ■  C2m) (2  ^(bd^V*  for  all  k  -  0  . 

Lemma  A. 2.  Let  D  be  a  subset  of  R*  and  let  {x  },  n  ■  0  ,  be 

i  --  --  ■■  ■  ■■■  n 

•  sequence  in  Ra.  Assume  that  the  following  conditions  hold,  where 
Q,  (t.  ),  k-0,  t*.  a,  d,  and  b  are  as  in  Lemma  A.l. 


(1)  11  WxnJl <B  Q(ll  VrxJ  *11  Vl’X0®  ]  whencver  VW  n 


(2)  x0  e  D. 

(3)  tj  -  llxrx0||  . 

(4)  x  c  D  whenever  ||  x- xQ  (|  «  t*  . 

(5)  The  hypotheses  of  Lemma  A.l.  hold. 

Then  the  following  conclusions  are  valid: 

(6)  ||  x^ - Xq (I  ■  t*  for  all  n  -  0  . 

(7)  { x^ }  converges  to  some  x*  with  ||x*-x0||  «  t*  . 

(8)  l|x#-xk,,||  «  f-tk4,  «  (2a)(2k  ‘WV1  for  all  K 

(9)  |jx  ,-x  !!  ■  t  ,-t  for  all  n  «  0  . 

v  *  "  n*l  n "  n*l  n 

The  following  standard  result  can  be  found  in  Ortega  and  Rhcinboldt 

M  • 

Lemma  A. 3.  Let  D  be  an  open,  convex  subset  of  Rn.  Let 
f:D  ♦  Rn  be  continuously  differentiable.  Suppose  that  for  some 
k  >  0,  ||  f  '  (u)-f '  (v)  ||  *  k ||  u-v||  whenever  u,v  c  D.  Then 
||  f  (u)-Lfy(u)  ||  «  Ik ||  u-v||2  whenever  u,v  c  0. 


1  ^ 
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Variational  Inequalities,  Complementarity,  Newton’s  method 


Newton's  method  is  a  well  known  and  often  applied  technique  for  computing  a 
zero  of  a  nonlinear  function.  By  using  the  theory  of  generalized  equations,  a 
Newton  method  is  developed  to  solve  problems  arising  in  both  mathematical  pro¬ 
gramming  and  mathematical  economics. 

Ve  prove  two  results  concerning  the  convergence  and  convergence  rate  of 
Newton's  method  for  generalized  equations.  Examples  are  given  to  emphasize  the 
application  of  this  method  to  generalized  equations  representing  the  nonlinear 
programming  problem  and  the  nonlinear  complementarity  problem.  (continued) 
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Abstract  (continued) 


We  present  computational  results  of  N'ewton's  method  applied  to 
a  nonlinear  complementarity  problem  of  Kojina  |3)  and  an  invariant 
capital  stock  problem  of  Hansen  and  Koopmans  |2). 


